Information Rate Loss due to Radiation Decoherence 
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The information rates achievable by using electromagnetic radiation affected by thermal noise 
and signal decoherence are studied. The standard coherent Gaussian model is compared with an 
alternative photon gas model which represents lack of a shared phase reference between transmitter 
and receiver. At any frequency, information rates over the photon gas model essentially coincide 
with those over the Gaussian model when the signal-to-noise ratio is below a threshold. Only above 
the threshold does decoherence cause a loss in information rates; the loss can amount to half of the 
capacity. The threshold exceeds 40 dB for radio frequencies and vanishes at optical frequencies. 



I. INTRODUCTION 

The consideration of quantum effects in information 
theory has a rich history, starting with the pioneering 
work of Gordon and laterpursued, among others, by 
Helstrom Q and Holevo [H, Hj]. A trait shared by these 
works is the special role played by thermal noise and 
coherent states, the natural quantum counterpart of the 
Gaussian model from classical communication theory. 

Inspired by recent work on reference frames in infor- 
mation theory ff| , where Schumacher is quoted as saying 
that "restrictions on the resources available for commu- 
nication yield interesting communication theories" , we 
consider, in addition to thermal noise, the effect of de- 
coherence, by which we mean absence of a shared phase 
reference between transmitter and receiver, and deal with 
the information rate loss incurred by such restriction, viz. 
decoherence between transmitter and receiver. 

Our work is related to the analysis of direct detection 
methods at optical frequencies [|| in the sense that com- 
munication is non-coherent. However, the discrete chan- 
nel model we use is different, as it represents the radiation 
field as a photon gas. Details arc given in Sec. [II] from a 
semiclassical perspective. The key element is that infor- 
mation is sent by modulating the energy of the Fourier 
modes of the field; at the receiver, energy is measured. 

In Sec. IIIII we determine the channel capacity of the 
photon gas model and derive the main result of this pa- 
per, namely that decoherence leads to no loss in infor- 
mation rate when the signal-to-noise ratio lies below a 
threshold; above the threshold, up to half of the capacity 
is lost. For a frequency v (in Hertz), this threshold is 

approximately given by 6,1 ° at 290 K, and is thus large 
only for radio and microwave frequencies. 

Previous studies of direct detection [3] showed a non- 
negligible capacity penalty. In Sec. Ill Bl we relate this 
discrepancy to a different way of accounting for the en- 
ergy of a mixture of thermal and coherent radiation. 



II. SEMICLASSICAL ANALYSIS 

In this section, we present a semiclassical analysis of 
the effect of radiation decoherence. We consider one 



polarization of the electromagnetic field at an aperture, 
which we denote by y(t), a complex- valued function. As 
is well-known, we can perform a Fourier decomposition 
of the function y(t) onto frequencies of the form v c + 
lying in a band of width W around a reference frequency 
v c \ here T is the duration of the observation interval. 

Further, the function y(t) is the sum x(t) + z(t), where 
the signal x(t) and noise z(t) are respectively given by 



i27r(i/ c +^)t 



(1) 

(2) 



here x m is the useful signal of mode m, set at the trans- 
mitter (except for a propagation loss and a phase rota- 
tion), and z m are samples of Gaussian noise; all quanti- 
ties are complex. With coherent detection, the quantities 
2/m = 8rn > z m are recovered at the receiver @. 

A. Radiation Decoherence and Photon Gas Model 

An implicit assumption behind Eq. ([T]) is the existence 
of a shared phase reference between transmitter and re- 
ceiver. In general, however, decoherence takes place and 
a phase drift <j) m (i), possibly a function of the Fourier 
mode m, appears. Following Lax's analysis of oscillator 
noise [8|, we model the phase drift <fr m {t) as a Brownian 
motion with zero mean and variance E[(^(i)] = 2ir f3 m t. 
The total signal at the receiving aperture is still given by 
y(t) = x(t) + z(t), but the transmitted signal is now 

<t)=Y.^r x ^ i "' m{t) ^ { - Vc+mt - (3) 

rn 

When (3 m = 0, we obviously recover the coherent 
model. However, for any f3 m > 0, however tiny, as the 
observation duration increases T — > oo, then the signal 
in the m-th output of a coherent receiver vanishes, i. e. 



J x{t)e- i2 < v ° +1 r^ dt = 2f J e 



# m (t) dt ~ 



(4) 

In this different detection method is required. For- 

tunately, the energy in the m-th mode is well defined (see 
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Sec. Ill Bp by the sum \x m \ 2 + \z m \ 2 . This suggests using 
a form of direct detection, which we now describe. 

By construction the signal x(t) is a mixture of inde- 
pendent frequency tones. Demultiplexing them at the 
receiver generates a set of parallel signals C m (*) given by 

C(t) = -^(x m e^ + z^e^+^K (5) 

The instantaneous energy C, m (t) = |CmW| 2 can be inte- 
grated in the interval (0,T) to generate an output y' m , 

V'm = t /(l^l 2 + + 2Re( Im e , ^Wz,;)) dt. (6) 

There are now two possibilities, depending on how fast 
the phase noise 4> m (t) varies in time. If 4> m (t) is constant, 
i. e. Pm — 0, the output y' m is given by 

y' n = \x m e i ^+z m \ 2 , (7) 

as for the squared output of a coherent receiver. In the 
approximation that the energy is continuous, y' m follows a 
non-central chi-square distribution; its square root y' m 
is distributed according to a Rician distribution. On the 
other hand, if the energy is discrete, the distribution of 
y' m is Laguerre with parameters \x m \ 2 and | 

-in I 2 UM- 

In the second alternative, we take f3 m T — > oo, and then 




namely the sum of the energies of signal and noise. 
As mentioned previously, this condition holds true as 
T — > oo as long as (3 m > 0. If the energy is assumed 
discrete, then the signal component is modelled as a Pois- 
son random variable and the additive noise has a Bose- 
Einstein distribution Q. One can think of this model 
as a photon gas, where the receiver counts the num- 
ber of photons in each Fourier mode. Otherwise, for a 
continuous-energy approximation, the noise energy \z m \ 2 
has an exponential density, which is both the limiting 
form of a Bose-Einstein distribution and the density of 
the squared amplitude of complex Gaussian noise [111 ]. 

The output y' m in Eq. (|5J) is the sum of the energies 
of signal and noise. It is worthwhile noting that this 
additivity in energy does not hold for the Laguerre dis- 
tribution, the standard result for the superposition of a 
thermal field and a coherent state. In the next section 
we briefly review the derivation of the Laguerre distri- 
bution and discuss the conditions under which energy is 
additive. Then, in Sec. IIIII we compare the information 
rates over the Gaussian model with those achievable by 
an energy measurement. We then use the difference in 
information rates between the coherent and non-coherent 
models as an estimate of the effect of decoherence. 



B. Additive Energy versus Additive Field 

For simplicity, let us consider the superposition of two 
continuous-time signals x\(t) and x 2 (t). The instanta- 



neous energy C"(t) is given by 

C"(t) = \ Xl (t)\ 2 + \x 2 (t)\ 2 + 2Re(n(t)i5(t)), (9) 

with a beat term Re(xi(<)x2(i)). Even though its mean 
is zero, it is not identically zero. Moreover it makes the 
total energy after integration different from the sum of 
the energies of x\ (t) and x 2 (t) , as in Eq. ([7]) . 

We solve this issue by noting that the superposition 
model is not unitary and choose instead a unitary matrix 
to represent it. Consider such a matrix U , 

1 ( 1 e*^\ 

"-UK-* 0' ,10 » 

where is a phase offset. Instead of Xi(t) + x 2 (t), there 
are now two outputs, say y\(t) and y 2 (f), linear combi- 
nations of the inputs, namely 

y 1 (t) = -±=(xi(t)+e i 1>x 2 (t)) (11) 

y 2 (t) = -^={-e i *x 1 (t)+x 2 (t)). (12) 

The instantaneous energy at each output, Ci 2 (t)i ^ s then 

C" 2 (*) = l(\Mt)\ 2 + hM| 2 ±2Re(x 1 (t)e i ^(t))) ) 

(13) 

where the sign +(— ) goes with output 1(2). The total 
output is the sum over the two branches, ("(t) + Ca (*)■ 

Each output, observed individually, follows a Laguerre 
distribution. However, the outputs are not independent 
but correlated through the beat term. As these terms 
have different sign, they cancel out when we sum the two 
outputs, and we indeed see that the total energy is the 
sum of the energy in the signal and the noise components. 

III. INFORMATION RATES 
A. Discrete Models for Radiation 

We have discussed two models, viz. coherent detection 
and energy detection. For the latter, we have in turn 
described two options, a photon gas model where the 
energy is discrete and an exponential noise model under 
the approximation that the energy is continuous. All 
cases are described by a channel model of the form 

y m = s m (x m ) + z m , m=l,...,n, (14) 

where y m is a measurement on the m-th Fourier mode, 
x m the m-th signal component, s m the useful signal at 
the output, and z m the m-th sample of additive noise. 
The specifics of each model are 

1. For coherent detection, y m , s m — x m , and z m are 
complex- valued. Further, z m are samples of Gaus- 
sian noise with variance a 2 . 
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2. For the photon gas model, y m , s m , and z m are non- 
negative integers, a number of photons of energy hv 
each. The signal component s m has a Poisson dis- 
tribution with mean x m , and the noise component 
z m has an Bose-Einstein (or geometric) distribution 
with mean e w = (e^r — 1) _1 , as thermal radiation. 
Here v is assumed constant for all modes, and equal 
to v c ; T is a temperature. 

3. For continuous energy, y m , s m = x m and z m are 
non-negative real numbers. Then, z m are samples 
of exponential noise with mean E n . 

In all cases, a constraint on the signal energy E s — e s hv 
is imposed, where e a is the average number of signal pho- 
tons, and E s the corresponding energy. Moreover, it is 
convenient to set a 2 = E n = e w hv. For the first and 
third models, we define an average signal-to-noise ratio 
SNR as SNR = E s /a 2 = E s /E n . 

The largest information rate that can be sent over a 
channel with output conditional density Py\x{d\ x ) is the 
channel capacity C [l2j], given by 



C = sup I(X;Y), 

Px(x) 



(15) 



where the maximization is over all input densities px (x) 
satisfying the energy constraint, and I(X;Y) is the mu- 
tual information between channel input and output. For 
continuous output the mutual information is given by 



I(X;Y)= J p x (x) J p Y \x{y\x)\og PY ^^ dydx, 

(16) 

where py(y) = f Px(x)py\x(v\ x ) dx. For discrete out- 
put, the integrals over y should be replaced by sums. 



B. Capacity with Coherent Detection 

In classical information theory, the capacity Ccias is 
given by the well-known Shannon formula 

C C ia S (£ s ,a 2 )=log^l + ^), (17) 

where a 2 = kT is a common approximation to the noise 
spectral density. In addition, with a quantum model for 
measurement, noise is additive Gaussian with variance 
and one obtains the quantum capacity 
with coherent detection Ccoh, given by 



Ccoh(£s,£,«) = log 1 + 



£w + 1 



(18) 



At radio and microwave frequencies, e w ~ ^ 3> 1 and 
we recover Shannon's formula, 

Ccoh^^O-CciasO^fcT 1 ). (19) 

These expressions give the information rates with ther- 
mal noise and in absence of decoherence. 



C. Capacity of the Photon Gas 

In the photon gas model, two sources of noise are 
present at the output: Poisson noise, arising from the 
signal itself, and additive noise. Distinct behaviour is 
to be expected depending on which noise prevails. In 
a first approximation, the behaviour is determined by 
the noise variance. The additive noise variance is given 
by s w {l + e w ) (it follows a Bosc-Einstein distribution), 
whereas the signal variance e s (it is a Poisson random 
variable) [ill ]. Of practical importance is the region 
where £„, > 1, for which the variances coincide when 
e s = e 2 w . When e s is below the threshold, additive noise 
prevails; above the threshold, Poisson noise dominates. 

In Appendix fAI we prove that the capacity C(e Sl e w ) of 
the photon gas model is upper bounded by 

C(e s ,e w ) <min(C G (e s ,e w ),C P (£ s )), (20) 

where Cq and Cp are respectively given by 

Gg(£ s ,£ w ) — H Gcom (e s + e,„) — H Gcom (e w ), 

Here HGeom(t) is the entropy of a geometric distribution 
with meant, given by HQ Com (t) = (1+t) log(l+t)— t \ogt. 
Note that Cp(e s ) does not depend on e w . 

Both functions Cq and Cp are monotonically increas- 
ing functions of e s . They have a crossing point, whose po- 
sition we now determine under the approximation e w S> 1 
and e s 3> s w . We can then use the asymptotic forms of 
the upper bounds to the capacity, 

C G ( £s , £ ™)~log(^ ~ilog( £s )~Cp( £s ), (22) 

and we obtain again the expression ~ e s , previously 
derived by reasoning in terms of noise variance. 

The threshold can be written in terms of the signal-to- 
noise ratio of the underlying classical channel, 



SNR* 



E a 



e s hv 
e,„hv 



kT _ 6 • 10 12 
hv v 



(23) 



where T — 290 K and v is the frequency (in Hertz). In 
decibels, SNR* (dB) ~ 37.8 - 101og 10 ^, where the fre- 
quency is in GHz. 

Next to the upper bounds, we derive in Appendix [B] a 
lower bound to the capacity. Its value is 



Clb = Hi 



Gcom 



{e s + e w ) - 



-H 



Gcom 



2(e s + e w ) 



X e — ^+^, — r| 



^log27re + log^e^(l + e w ) + j^j 



, (24) 
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where T(0, t) is an incomplete gamma function, T(0, t) = 
f°° u~ 1 e~ u du. 

The threshold can be seen in Fig. [TJ which depicts the 
upper and lower bounds to the capacity as a function 
of the input number of quanta £ s and for several values 
of e w . The upper and lower bounds are close, differ- 
ing by at most 1.1 bits. The looseness at low e s is due 
to the pessimistic estimate of the conditional output en- 
tropy H(Y\X) (details are given in Appendix [B|) . which is 
smaller than the Gaussian approximation we have used. 
At high e s the gap is likely due to the non-optimal input 
distribution, a gamma density with v — 1/2, the density 
used in [14| on the bound the capacity of the discrete- 
time Poisson channel would likely close this gap. The 
capacity is closely given by the upper bound in Eq. (f20l) . 
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FIG. 1: Bounds to the capacity for several values of e w . 

As proved in Appendix [Cl for finite values of e s , 
Cg(s 8 ,s w ) is bounded by 



log + < C G (e s ,e w )< log 1 + ^1 j. (25) 



The information rates over the photon gas model are 
strictly smaller than those of the classical limit with sig- 
nal energy E s — e s hv and noise a 2 — e w hv. Never- 
theless, the loss due to decoherence is negligible when 
e s < £*; here we assumed that the upper bound to the 
capacity is tight (see comments above and Sec. IIIIDD . 
On the other hand, above this energy level, the upper 
bound Cp becomes dominant, and eventually half of the 
achievable information rate is lost to decoherence. 

A connection, worthwhile mentioning, can be made 
with non-coherent communications in Gaussian channels 
, where one of the two signal quadratures is not used, 
and a similar change in slope in the capacity takes place. 
A similar limitation arises in phase-noise limited channels 
[l5l | . As the threshold s* s is close to the point where exist- 
ing digital communication systems using electromagnetic 
radiation suffer from the effects of phase noise, it would 



be interesting to verify which of the two models defines 
most accurately the effective channel capacity. Regard- 
ing this issue, note that the cost in information rates 
of maintaining the phase coherence between transmitter 
and receiver are usually ignored. 



D. Capacity over the Continuous Energy Model 

Under the approximation that the energy is continu- 
ous, Poisson noise vanishes, in the sense that the density 
of the random variable signal energy approaches a delta 
function, ps\x( s mhv\x m hv) — > <5((s m — x m )/w/). In ad- 
dition, the Bose-Einstein distribution collapses onto an 
exponential density. 

The capacity of a channel with additive exponential 
noise was studied by Verdii [l(|. Applied to our channel 
model, we obtain the somewhat surprising 



Caen (E s , E n ) = log 1 




(26) 



as in the classical limit with Gaussian noise. Of course, 
this was to be expected since this model is a good descrip- 
tion of the regime where Cq accurately gives the capacity, 
and the formula here follows from Cg 



IV. CONCLUSIONS 

In this paper, we have compared two models for the 
transmission of information via electromagnetic radia- 
tion: the standard wave model with Gaussian noise and 
an alternative as a photon gas, where the radiation is an 
ensemble of photons over a set of Fourier modes. The sec- 
ond model represents a scenario with decoherence in the 
form of absence of phase reference between transmitter 
and receiver. We have limited our analysis of decoherence 
to coherent states (in a semiclassical formulation) and do 
not consider quantum states such as squeezed states or 
Fock states, neither the use of entanglement. 

Even though decoherence makes the von Neumann en- 
tropy of the source radiation states increase , it does 
not necessarily lead to an information rate loss, even 
though the quadrature components of the field are not 
used separately. Essentially, the entropy of the received 
signal is determined by that of thermal radiation, if the 
signal energy is below a threshold. A simple approxima- 
tion for this threshold has been given. Below this thresh- 
old, there is no information loss caused by decoherence; 
above it, up to half of the chanel capacity is lost. 

Capacity-achieving systems at radio and microwave 
frequencies operate below the threshold; optical systems 
are known to suffer from phase noise [6J]. It would be 
interesting to find a practical example whose informa- 
tion rates, including the cost of maintaining coherence, 
would exceed that of the photon gas model. We conjec- 
ture that the information rates of practical communica- 
tion systems are bounded by the capacity of the photon 
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gas model and may be thus significantly smaller than 
those obtained from a Gaussian model. 

Finally, we mention that the photon gas model is some- 
what close to a representation of classical matter as a set 
of particles, and that the results presented in this paper 
may be of help in exploring the quantum-classical border 
for radiation. Differently from other examples of deco- 
herence 17], the time scales at which einselection (in a 
quantum formulation of our semiclassical analysis) takes 
place are easily controllable, and therefore in principle 
observable, as opposed to decoherence in matter. 



APPENDIX A: UPPER BOUNDS 

For any input px(x) the mutual information satisfies 

I(X;Y)=H(Y)-H(Y\X) (Al) 
<H Gcom (e s + e w )-H(S(X) + Z\X), (A2) 

as the geometric distribution has the highest entropy un- 
der the given constraints [12]. Then, 

H(S{X) + Z\X)>H(Z\X)=H(Z), (A3) 

because the entropy of a sum of two independent random 
variables is at least as large as than the entropy of each 
of them (Exercise 18 of Chapter 2 of [Hj]) and Z and X 
are independent. Therefore, 



I(X;Y)<H G 



Gcom 



(e w ). 



(A4) 



As this holds for all inputs the upper bound Cq follows. 

The variables X, S(X), and Y(S) form a Markov chain 
in this order, X -> S(X) -> Y = S(X) + Z, so that an 
application of the data processing inequality [12] yields 



I(X-Y) <I(X;S(X)), 



(A5) 



that is the mutual information achievable in the discrete- 
time Poisson channel; a good upp er bound to the capac- 
ity of the latter was given in [lj] . 



APPENDIX B: LOWER BOUND 

Our lower bound is derived from the mutual informa- 
tion achievable by a specific input with density 



Px(x) 



(e s + e w ) : 



-e 



-S(x), x>0. 



(Bl) 

It is easy to prove that the channel output induced by this 
input achieves the largest output entropy; a similar proof 
can be found in [16] for the exponential noise channel. As 
a particular case we recover the exponential input, which 
maximizes the output entropy of a discrete-time Poisson 
channel [l3j |. 

By construction, the output is Bose-Einstein (geo- 
metric) with mean e s + e w and the output entropy 



H(Y) is therefore given by H(Y) = HQ Com (e s + e w ). 
We compute the mutual information with this input as 
H{Y) - H(Y\X). 

We estimate the conditional entropy as 

/>oo 

H(Y\X)= H{Y\x) Px {x)dx. (B2) 
Jo 

We obtain a term - ^ e H(Y\x — 0), which can be com- 
puted as H(Y\x = 0) = -ffGcom(£to)- A second summand 
is upper bounded by the differential entropy of a Gaus- 
sian random variable (see Theorem 9.7.1 of [13]), 



(B3) 



H(Y\x) < -log27re(Var(Y» + i 



= ilog27re(x + e^(l + £^) + ^). (B4) 

The desired expression follows from carrying out the inte- 
gration and using the definition of the incomplete gamma 
function. 



APPENDIX C: BOUND ESTIMATES 

First, we prove the strict inequality 

log(e s +s w ) -loge w > C G (e s ,s w ), (CI) 

for all values of e s > 0, e w > 0. Using the definition of 
Cq, we rewrite this expression as 



(1 + e s + e w ) log ^ s + £w > (1 + £ W ) log 



1 + e s + Ey 



1 + Sv 



(C2) 



Proving this is equivalent to proving that the function 
fit) — (1+t) log jq^-is monotonically increasing for t > 0. 
It is indeed so since its first derivative f'(t) is 



/'(*) = ]-log(l + \), (C3) 



which is positive since log(l + t') < t' for positive t' . 
We now move on to prove 

C G (e s , e w ) > log(e s + e w + 1) - log(e w + 1). (C4) 

From the definition of Cq, and after cancelling common 
terms, we rewrite the condition as 

{e s +e w )\og > £ w log . (C5) 

This equation is true because the function /(£) = 
tlog(l + j) is monotonically increasing for t > 0, since 
it monotonically approaches the number e from below. 
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